2 links tagged with all of: ai safety + anthropic + claude
Click any tag below to further narrow down your results
Links
Anthropic's AI tool, Claude, has gained significant traction among consumers, with paid subscriptions more than doubling this year. The growth coincides with a public feud with the Department of Defense and effective Super Bowl ads that positioned Claude as a safer alternative to competitors. Despite this success, Claude still trails behind ChatGPT in overall user numbers.
- Claude's paid subscriptions have more than doubled in 2024, based on analysis of ~28 million anonymized US credit card transactions, with a sharp jump between January and February.
- Most new subscribers are choosing the cheapest $20/month "Pro" tier rather than the $100 or $200 plans, with growth also driven by new features like Claude Code, Claude Cowork, and Computer Use.
- Anthropic's public refusal to let its AI be used for lethal military operations (unlike OpenAI, which struck its own DoD deal) plus Super Bowl ads mocking ChatGPT have boosted Claude's profile as a "safer" alternative.
- Despite this growth, Claude still trails ChatGPT in total users, and OpenAI continues adding paid subscribers quickly despite backlash over its DoD deal.
The article discusses the new version of Claude's constitution, which outlines explicit values for AI behavior. It explains how Constitutional AI improves upon traditional human feedback by using AI-generated principles to ensure safer and more transparent model outputs. The principles aim to address ethical concerns while allowing for continuous improvement.
- Constitutional AI replaces most human feedback with AI self-critique against a written constitution, then AI-generated reinforcement learning for harmlessness, cutting the need for people to review toxic content.
- Claude trained this way got better at handling adversarial prompts without becoming less helpful, and the approach makes the values steering the model's outputs more transparent.
- The constitution draws on sources like the UN Declaration of Human Rights and other labs' safety practices, but Anthropic admits it's still skewed toward Western viewpoints and remains a work in progress shaped by trial and error.